This locution refers to "acting with honesty, selflessness, generosity," which may be something related to the idea of offering one's heart (feelings) or be inspired by the custom of holding in one's hand an image of the Sacred Heart of Jesus when taking the oath. To see "with your hand on your heart".